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OPTICAL WATERMARK 

Field of the Invention 

This invention generally relates to a method and apparatus for 
producing optical watermarks on printed and electronic documents. 

Definition 

Throughout this specification or reference to a document is to be 
taken as including a printed document and/ or an electronic 
document and/ or a copy (printed or electronic) of a printed 
document and/ or a copy (printed or electronic) of an electronic 
document and will include such a document with text, image, 
graphics, video, photographs, and other multimedia appearing 
thereon or therein. 

Background to the Invention 

The structure of a watermark, referred to as carrier dot pattern, is a 
repetitive pattern with the simplest and most basic as a two- 
dimensional ("2-D") dot array. The complexity of the dot pattern 
structure determines the security level. Embedding a latent image 
object into a watermark is implemented by the modulation on the dot 
pattern with the latent image object. Observing the latent image 
using a decoder is a process of demodulation. The decoder is also a 
structured pattern, which corresponds to a particular dot pattern. It 
is implemented as an optical instrument, such as gratings, lenses, 
Ronchi Rulings, special films, or even a photocopier. 

Consideration of the Prior Art 

US 5,915,027 relates to digital watermarking of data, including 
image, video and audio data, which is performed by repeatedly 
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inserting the watermark into subregions or subimages of the data. 
Similarly, the watermark is repeatedly extracted from the subregions 
of the data. This method is in a single layer and is not suitable to a 
text-based document or a document printed on paper. 

US 4,921,278 has an identification system using a computer 
generated Moire, and is based on a computer generated random 
pattern of broken lines. The overlap of the object grid and the 
reference grid will induce the moire effect. This method is in a single 
layer, is rather simple, and does not provide enough protection, such 
as counterfeit indication. 

US 5,734,752 is a method for generating watermarks in a digitally 
reproducible document which are substantially invisible when 
viewed. It uses stochastic screen patterns suitable for reproducing a 
gray image on a document, and another stochastic screen to 
correlate the first in order to view the content. This is quite similar to 
US 4,921,278, except that it uses stochastic screen patterns to 
represent the gray images. 

Other patents similar these include: US 5,708,717 which combines a 
source image with a latent image so that the scrambled latent image 
is visible only when viewed through a special decoder lens; US 
5,790,703 produces a first screen pattern suitable for reproducing a 
gray image on a document, and deriving at least one conjugate 
screen description that is related to the first pattern, so that 
overlapping them can reveal the content of the document; and US 
6,000,728 uses different sizes of dot screens for anti-counterfeiting. 
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As can be seen from these US patents, there is only one layer of 
hidden information. The structure is exposed to attackers. Carefully 
observation of the structure with a microscope or similar instrument 
will reveal all information required to forge the image or document. 
It is the principal object of the present invention is to address this 
problem and to provide a watermark which, in general, will not 
normally allow all necessary information to be revealed. 

Summ ary of the Invention 

The present invention provides a method and apparatus to protect 
documents from counterfeit and forgery. It embeds multiple latent 
image objects into layers of repetitive structures to generate a 
watermark. The watermark is then incorporated into a document as 
for example, a seal, logo or background. This may be referred to as 
an optical watermark. 



An optical watermark has one or several watermark layers. One or 
two latent image objects are embedded into each watermark layer 
Each watermark layer has different structure, as well as a 
corresponding decoder to observe the latent image object embedded 
in it. The latent image object embedded in a watermark layer can not 
be observed by the unaided human eye unless a decoder 
corresponding to that watermark layer's structure is overlapped onto 
the watermark. On the other hand, a decoder for one watermark 
layer will not reveal latent image objects in other watermark layers 
due to the difference in their structure. As such, decoders can be 
considered as keys to the secrets, and the secrets are the latent 
image objects embedded in the watermark. 
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Layers in the optical watermark protect each other. Without knowing 
all the secrets (including latent image objects and parameters of the 
dot patterns) of the optical watermark, it's almost impossible to forge 
the watermark or change the latent image objects in watermark 
layers without being noticed. 



The combination of layers of various security levels provides 
solutions for various applications needs. For example, an optical 
watermark may appear as the logo of a company on a document 
issued by that company. There can be, for example, three watermark 
layers. The first layer may be a cancellation word, such as "COPY", 
and the verification device is the photocopier. The cancellation word 
"COPY" appears if the printed original document is photocopied. The 
latent image object in the second layer may be a logo of the company, 
and the verification device is a specially designed lens with gratings 
defined by periodical functions. The lens can be given to the related 
organisations to verify the originality of the document. The third 
layer may be embedded with a logo of a trusted third party. The 
verification device is also a lens, but the structure is random dot 
pattern, which is more secure than the other layers. 

Because the superposition of multiple layers is a non-inversable 
process, the complicity of the optical watermark increases and it is 
very difficult, if not impossible, to reverse engineer to derive the 
parameters and hidden information from the watermark. Because 
there are multiple layers, different verification methods, including 
counterfeit indication, can be combined to form a much more secure 
application. These verifications can be done off-line with very simple 
devices. Above all, the invented method and aparatus can achieve 
very high security without using special ink or special paper. 
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Brief Description of Drawings 

In order that the invention may be clearly understood and readily 
put into practical effect, there shall be described by way of non- 
limitative example only preferred embodiments of the present 
invention, the description being with reference to the accompanying 
illustrative drawings in which: 

Figure 1 shows a layered structure of an optical watermark; 

Figure 2 is an illustration of embedding latent image objects into a 

basic watermark layer; 

Figure 3 is a demodulation result of letters "T* and "C"; 

Figure 4 shows the structure of the optical watermark; 

Figure 5 shows a watermark with a random dot pattern; 

Figure 6 shows a counterfeit-proof watermark layer with a letter "P* 

embedded; 

Figure 7 is an electronic application; and 
Figure 8 is an electronic service model. 

Detailed Description of the Preferred Embodiment 

The optical watermark in this invention has a multiple layered 
structure as shown in Figure 1. Watermark layers are superposed on 
each other to provide multiple layers and categories of protection. 
This superposition of several layers means that it is very difficult, if 
not impossible, to derive the parameters of the structure and the 
hidden information from the optical watermark alone. 

Each watermark layer is a repetitive structured array of dots. Latent 
image objects are embedded into the watermark layer by modulation. 
This may include, for example, phase modulation. The structure and 
orientation of the different watermark layers in an optical watermark 
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must be different from each other. Only the decoder corresponding to 
a particular watermark layer can be used to view the latent image 
object embedded in that particular watermark layer. 

Basic watermark layer - 2-D dot arrays 

The basic watermark layer is a 2-D dot array, varying in two 
orthogonal directions. To embed latent images, phase modulation 
can be applied to both directions. As shown in Figure 2, part 205 is 
the phase modulation in the horizontal direction to embed a letter 
"T", while part 206 shows the phase modulation in the vertical 
direction to embed a letter "C*\ 

The phase modulation changes the distances between a pair of dots 
at the edge of the latent images in the direction of the phase 
modulation. According to the characteristics of the human visual 
system, such changes of distances will make the edge of the latent 
image become either lighter or darker than the overall grey level of 
the dot array. Such effect will reveal the shape of the latent images. 
In order to compensate for this effect, a "smoothing" process may be 
applied to the regions with an abrupt phase shift. For example, in 
Figure 2, along regions indicated as 201 and 202, the distance 
between a pair of dots was greater than the spatial repetitive period 
of the dot array. Therefore, a dot is added, together with distance 
adjustment, to make the edge a little darker. Patterns 201 and 202 
are the results after compensation. On other hand, when the 
distance between two dots is much smaller than the repetitive period 
of the dot array, distance adjustment may also be necessary to make 
the edge a little lighter. Patterns 203 and 204 are the result of this 
type of adjustment. 



WO 02/23481 



PCT/SGOO/00147 



7 



To view the latent image objects in the modulated dot arrays, the 
decoder should have a grating structure with the same spatial 
frequency as the dot arrays. In order to demodulate the latent image 
modulated in a particular direction, the orientation of the decoder 
should be aligned in the same direction. Figure 3(01) and Figure 
3(02) show the demodulation result of Figure 2. The detailed 
mathematical analysis is in accordance with a Fourier Series 
Expansion. 

Mathematical Analysis of Phase Modulation for Embedding a Latent 
Image into a Basic Watermark Layer 

In the optical watermark, dot arrays are selected as the carrier dot 
patterns to embed latent image objects. Because dot arrays can be 
considered as 2-D signals, which vary in two orthogonal directions, 
two latent image objects can be modulated to one dot pattern in two 
directions with phase modulation. For the sake of simplicity, the dot 
arrays discussed here have the same spatial repetitive frequency in 
both directions. In an actual optical watermark, the frequencies in 
the two directions may be different. 

A Fourier series expansion is employed to analyse the modulation 
and demodulation. Let us denote basic dot pattern as /e E 0 ^ 
Mx,y), where and the value 0 represents black, and 1 represents 
white. The superposition of line gratings can be represented with the 
product of functions. This multiplicative model enables analysis with 
a Fourier series expansion. 

The phase-shifted dot array can be represented as and 
f 2 (x,y) , each corresponding to a modulation direction. 
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/o (x,y) = l- J S{x - nT) f^S(y -nT) (1) 



/, (x, y) = 1 - J - „r £ <y(y - «T) ( 2 ) 



/ 2 (^^)=i-2;^-«r)|; < 5Cv-«r-^) (3) 



Two latent image objects to be modulated can be represented as 
g x (x,y) and g 2 (x,y). Their valid values can only be either 0 or 1. So 
the watermarked dot array can be represented as 

w(*> y) = g t (x, y)g 2 (x,y)f Q (x,y) + 

[1 ~gi(x, yM(x,y) + [l-g 2 (x,y)lf 2 (x,y) (4) 

The decoders can be represented as 

C O 

/Ax,y) = l-^( xc °sO-ysin0-nT) (5) 

In eq. (A.5) the angle 6 is the angle between the orientation of 
f d (x,y) and the direction of y-axis. The superposition of the 
watermarked dot array and the decoder can be represented as 

d(x,y) = w(x,y)f d (x,y) (6) 



All these functions can then be expanded into Fourier series as 
following. 

/. (*. JO -!-[£ + 1 Zcos(2*£*)][I + |S cos(2^)] (7) 
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fi(x,y) = 1 + ^cos( n n)cos(2xjx)][± + ^cos(2x^y)-] (8) 
fz(x,y) = 1 -[I + |2]cos(2^^x)][I + l|;cos(wr)cos(2,riy)] (9) 
fd (x, y) = (1 - — ) - - ^ cos[2^ - (x cos 0 - y sin 0)] ( 1 0) 

1 1 n<*l 1 * 

The superposition can be analysed based on above expansions. 
There will be many components in the expansion of eq. (A.6). In order 
to make the analysis as clear as possible, all high frequency 
components can be ignored. Only the components, which probably 
have lower frequencies will be referred to in this analysis. Such 
components in d(x,.y) are analysed as following equations. 

Sco S (2^^)|cos[2^^(xcos6>-vsin^)] = i|]|;c I ( W5 „) + Cl ( 7 „,-„ ) 

(11) 

c, (m, «) = cos ~[( m + n cos 0)x - ny sin 0] (1 2) 
£co S (2^^v)Jco S [2^|(xcos0-vsm0)] = l£|; C2 ( m) „) + C2(Wj _„ ) (13) 



c 2 {m,n) =cos~ [mccos0 + (m-n sin 0)y] (14) 



When the value of 0 is very close to 0% only the frequency of the 
component Cl (l,-1) will be much lower than the frequency of the 
carrier dot pattern. While the value of 0 is slightly above or below 
90% only the component c 2 (l,l) will have lower frequency. So for 
these two cases only c ,(l,-l) or c 2 (l,l) will be significant in 
superposition. 
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c, (1,-1) = cos y [(1 - cos 0)x + y sin 0] (1 5) 
2n 

c 2 (1,1) = cos — [x cos e + (1 - sin 0)>>] ( 1 6) 

In case when c x (1,-1) is most significant, the significant components 
in eq. (6) will be the following three. Then only one latent image 
gi( x >y) can be clearly observed because of the relative phase. 

1 ) gi (X y)g 2 (*, y) cos y- [(1 - cos 6) x 4- y sin 0] 

2) [1 - g x (x, J0]cos^[(l - cos0)x + j;sin0 ± -] 

3 ) I 1 - g 2 ( x > y)l cos — [(1 - cos 6) x + y sin 6] 



In case when c 2 (l,l) is most significant, the significant components in 
eq. (6) will be the following three. Then only one latent image g 2 (x,y) 
can be clearly observed because of the relative phase. 

1 ) £i (x, y)g 2 (x, y) cos y- [x cos0 + (1 - sin 0)y] 

In 

2) [1 - gi (*, y)] cos— [x cos 6 + (1 - sin 0)y] 

3) [1 ~ g 2 (*> y)] cos — [ x cos 9 + (1 - sin 0)y ± — ] 

The mathematical derivation shows that with phase modulation two 
latent image objects can be modulated to the basic dot pattern. 
Because of the relatively high frequency of the dot array and the 
compensation methods applied on the edge, the latent image objects 
will not be observed by unaided eyes. In order to view the latent 
image objects, the frequency of the decoder should be the same as 
the frequency of the basic carrier dot pattern along that direction, 
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and the orientation of the decoder should be aligned to the same 
direction in which the latent image object is modulated. 



Here there are used two characteristics of the human visual system. 
First, the human visual system has the highest contrast sensitivity 
in the mid spatial frequency range, around 2-6 c/deg. The sensitivity 
has a sharp drop at high spatial frequencies. Second, the human eye 
is sensitive to relative phase, which is the shift or displacement 
between spatial signals at same frequency. For frequencies higher 
than 3 c/deg, the threshold phase is represented by the 
displacement of about 0.85' arc. For frequencies less than 3 c/deg, 
the threshold of relative phase is about jr. A human observer will not 
be able to observe the relative phase, which is less than this 
threshold. So for high frequency signals, the displacement will not be 
easily observed by unaided eyes. 

The latent image object in each watermark layer is encoded with 
relatively high repetitive frequency dot patterns with phase 
modulation. The displacement is not significant to the human visual 
system because the relative phase difference is lower than, or similar 
to, the threshold at that relative high frequency, which is selected for 
the optical watermark. So the latent image objects will not be 
observed without proper decoders. 



To generalise from the 2-D dot array watermark layer, the 
frequencies of dot arrays along two directions can be different and 
the dot arrays may take any orientation. If the watermark layer is 
denoted as K/„^, W( ), where f u and /v are the frequencies of 
dot array in two directions u and v, respectively, and 6 is the angle 
between * and 2 (horizontal axis), the functions gu and whose 
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value can only be 1 or 0, represent the latent image objects in this 
layer. The function representing a watermark layer is: 

/. .~ / v 2// J 

(17) 



There are two parameters for each latent image object in this type of 
watermark layer: one is the modulation frequency and the other is 
the modulation orientation. The parameters for the latent image g u 
are f u and u . While the parameters for the latent image g v are f v 
and v . Only a decoder with the corresponding frequency can make a 
particular latent image visible when it's rotated to the corresponding 
direction. So the keys to the secrets in this type of watermark layer 
are the modulation frequency and the modulation orientation. 

Multiple Layers Structure 

Reference is now made to Figure 4 where Figure 401 shows the co- 
ordinates of one watermark layer, with reference to a x-y co-ordinate. 
Figure 402, 403 and 404 are three watermark layers, and Figure 405 
is their superposition result. 

The optical watermark is the superposition of several watermark 
layers. Such superposition can be represented as 



N 

W = Tl L »(f«,*>AnA,g u ,„,g v . n ) (18) 
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According to the above analysis, there would be some low frequency 
components in this superposition of multiple repetitive structures. 
Such low frequency components could probably bring unwanted 
visual effects, or even reveal the latent images without decoders. This 
problem can be avoided if the following requirements can be met for 
any two layers, L, and Z y , in the optical watermark: 

1 - If fuj^fuj or / v/ =/ vy> the orientation difference A0 tJ should be 
large enough, for example A0 i} £60", or in some cases A0 V £45' . 

2 - If fu,i =f v ,j, A0 9 should be less than 60°, for example A0 ff £60° . 
(where A0 tj = arccos(|cos(^ -0j)\), and 0° £ A0 V <90°) 

The above two requirements mean that no component will have a 
frequency much lower than the frequency of any carrier dot arrays in 
the superposition. Figure 4(05) shows an sample of the optical 
watermark, which is the superposition of Figure 4(02), Figure 4(03) 
and Figure 4(04). 



When the decoder, which is represented with the fuction d(x,y) , are 
superposed onto the optical watermark, the result of the decoding 
can be respresented as 

D = di^yyw = d( X ,y) -tlW^M.g^ * ) 



«»1 



d(x,y) = l-£ S(xcos0 d +ysva0 d - (20) 

fd 



From the analysis in Appendix A, the following results can be 
obtained: 
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1. When f d equals /„, and \e d -0\ is very small, the latent image 
g u ,i( x >y) wiD be visible in the superposition. 

2. When /„ equals /„, and \0 d -O,\ is almost 90', the latent image 
S,A x >y) will be visible in the superposition. 

The frequency and the orientation of the decoder are the keys to 
decode the latent image objects. Only when the frequency of the 
decoder matches the modulation frequency and orientation of a 
particular latent image object, will the latent image object appear in 
the superposition. 

Hence, in the mutilple-layer stucture, all latent image objects can be 
decoded seperately from the watermark layers. Every watermark 
layer carries its own latent image objects, and from the knowledge of 
one particular watermark layer it is very difficult, and almost 
impossible, to derive the latent images or the parameters of the other 
watermark layers. 



The other advantage of this multiple-layer structure is that all the 
watermark layers protect each other. Without knowing the details 
(parameters and latent image objects) of all the watermark layers, it's 
very difficult, and almost impossible, to change the information in 
one of the watermark layers. If one of the watermark layers is 
changed, all other watermark layers will also be affected by this 
change. Therefore, this change, even it may be authorized by one 
party, will invalidate the authenticity of the document, in a scenario 
of a multiple party application, where each party is holding a "key" to 
a latent image object. 
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Coordinate mapping t o generate complex watermark lay er 
In a basic watermark layer, the key space to the hidden information 
is the frequency of the decoder, which is relatively small. Generally, 
basic 2-D dot arrays can be generalized to any 2-D pattern, by 
coordinate mapping and superposition. 



In the case of coordinate mapping, linear or non-linear coordinate 
mapping functions are applied to the basic watermark layer. These 
mapping functions can be represented as 

x = m x (u,v) (21) 

y = m y (u,v) (22) 



Functions m x (u,v) and m y (u,v) map the coordinate space from («,v) 
to (x,y). In («,v) coordinate space, the modulation and demodulation 
of the watermark layer are the same as the basic watermark layer. 
But the demodulation with a decoder is done in the (x,y) coordinate 
space. Hence, the decoder in the (x,y) coordinate space should be 
mapped from the corresponding decoder in the (u,v) coordinate 
space. So in coordinate mapping the watermark layer, the 
parameters of a latent image object are the modulation frequency of 
the latent image object in the («,v) coordinate space, the modulation 
orientation of the latent image object in the («,v) coordinate space, 
and the mapping functions m x (u,v) and m y (u y v) . 



For example, the sine function as the mapping function. The 
mapping of coordinate system can be represented as: 



. In 

x = sm — v + u (23) 
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y = v (24) 

While the dot array in the (u,v) coordinate space is represented as: 

/(«.v)-l- 2 S(M-±)£6tv-±) (25) 

With coordinate mapping, the corresponding faction in the (x y y) 
coordinate space can be derived as: 

ftx.y) *<* - rfn^y ~) 2 *(y - -f) (126) 

In order to demodulate the latent image object embedded in the 
watermark layer with coordinate system mapping, the original 
decoder should also be mapped from the (w,v) coordinate system to 
the (x 9 y) coordinate system: 

*(«.v) = l-2*(»-4) (27) 

^^) = l- 2 S(x-sm^-y--^) (28) 

For the latent image in the mapped watermark layer f\x,y), the 
corresponding decoder is d\x,y) in eq. (28) but not d 0 (x,y) in eq. 
(27). As can be seen from equation (28), that the key space is 
expanded by two factors: one is the sine function, and the other is 
the period of the sine function. 

Random pattern watermark Laver 

To refer to Figure 5, Figure 501, 502 and 503 are simple watermark 
layers with/ without phase modulation. It is relatively simple to 
derive parameters from them. Figure 504,505 and 506 are 
watermark layers with random dot patterns. It is very complex, and 
virtually impossible, to recover latent image object information 
without decoders. 
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The key space of the decoder used to view the embedded latent image 
object is an indication of the security a watermark method or 
apparatus may have. The key space is very small for the prior art 
patents listed earlier. It is possible to find the key space with careful 
analysis or brute force attack from an expert in the area. As a few 
examples, Figure 501, 502 and 503 show regular patterns with 
andwithout phase modulation. From the view point of cryptography, 
the problem of these watermark layers is that the space of the keys is 
too small. It is obvious that one can easily derive the key parametter 
by observing the watermark. 



By linear and non-linear mapping of the basic watermark layer, the 
key space can be expanded by two factors. To further expand the key 
space to increase the security of the hidden information, the 
watermark layer can be further generalised as a random pattern in a 
2-D space. 



According to information theory, the amount of information of the 
latent image object can reach its maximum when it is randomly 
distributed. In a random pattern watermark layer, the randomly 
distributed information is divided into two parts: the watermark layer 
is generated based on one part, while the decoder is generated based 
on the other part. Hence, both of the watermark layer and the 
decoder hold the information about the latent image object. The 
latent image is recoverable only when both the watermark layer and 
the decoder are presented. 



Two functions g w (x,y) and g d (x,y) can be generated based on the 
latent image object g(x,y) and a random function r{x,y), which will 
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return either 0 or 1 at random. The function g w (x,y) is then encoded 
into the girds of the watermark layer with phase modulation, while 
the function g d (x,y) is also encoded into the line gratings of the 
decoder with phase modulation. Note that the value of g„(x,y) , 
S d (x,y) and g(x,y) can only be either 1 or 0. 

g»(x>y) = g(x,y)r(x,y) + [\-g(x,yy}[l-r(x,yy) (29) 
gA*>y) = r(x,y) (30) 



No information about the latent image object can be found from 
investigating the function either g d (x, y) or g w (x,y). There is a 
relationship between the function g d (x,y) and g w (x,y) . If the value of 
g(x,y) is 1, the function g d (x,y) equals to g w (x,y). While if the value 
of g(x,y) is 0, the function g w (x,y) equals to l-g d (x,y). 

The watermark layer can be represented as: 

™(x,y) = g.(x,y)[l- Y,8{x~nT x )Y J S{y-nT y )\ + 

"—^ (31) 

- £ S{x- nT t - It;) J 8{y - nT y )} 

And the decoder as: 

^ (32) 

From above equations, it can be seen that when the value of g(x,y) is 
0, there is a relatve phase difference between the watermark layer 
and the decoder, and that when the value of g(x,y) is 1, there is no 
relatve phase difference between the watermark layer and the 
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decoder. This implies that the latent image will appear because of the 
demodulation of the relative phase difference when the watermark 
layer and decoder are correctly overlapped. 

Figures 504, 505 and 506 are examples of the random pattern 
watermark layers corresponding to Figure 501, Figure 502 and 
Figure 503. 



Since the amount of information in a random pattern watermark 
layer is 2 to the power of the dimension of the latent image object, 
the security level will be very high. Since both the watermark layer 
and the decoder carry part of the latent image object, from either the 
watermark layer or the decoder alone it is virtually impossible to 
derive the other. On other hand, a random pattern watermark layer 
needs accurate alignment to reveal the latent image object. 

Counterfeit-proof Lay er 

The dot pattern of a watermark layer can be the result of a set of 
operations on one, or a set of basic, and other types of dot patterns. 
Here, the counterfeit-proof layer is an example. 

The counterfeit-proof layer is a special watermark layer where a 
photocopier is the decoder to the latent image object. The dot pattern 
in the counterfeit-proof watermark layer is based on the 
superposition of the basic dot arrays. The latent image object in this 
layer, which can be some cancelation words such as "COPY", can be 
represented as a function g c (x,y). The value of this function can only 
be 0 or 1. Then this layer can be represented as a function w c (x,y) . 
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w c (x, y)=[l- g c (x, y)]f a (x, y)f a (x + A, y + A) + 

s. (*> y)A (*> y)fb( x+ -£>y+-£) (33) 

fa(x>y) = l-Y l S(x-nT a )J^S(y-nT a ) (34) 
/ 4 (x.j0-1- Y l S(x-nT b )Y i S(y-nT b ) (35) 



The functions / a (x,>;) and f b (.x,y) represent two sets of basic dot 
arrays. The repetitive period T a of f a {x,y) is slightly larger then the 
period T b of f b (x,y). And the A in eq. (33) represents a small 
displacement. 



Figure 601 is a sample of such a counterfeit-proof layer. Figure 602 
is a enlarged view of the overlapped dot arrays which are represented 
by f a (x ) y)f a (x + A s y + A). Each dot in the dot array f a (x,y) will adjoin 
to a dot in the other dot array f a (x + A,y + A) because A is a small 
enough displacement. While Figure 603 is an enlarged view of the 
overlapped dot arrays which are represented with 

ft(x,y)f b ( x +-±,y+JL). Because of the displacement ^ , no dot in the 
dot array f b (x,y) will adjoin to a dot in the other dot array 

/i(X + f'^ + f ) - 

In order to let the latent image object appear after photocopying, the 
dot size in this counterfeit-proof layer should be carefully chosen. It 
should be smaller than the size of the dot that a photocopier can 
sample. 

A preferred dot size is ^ inches, because the optical resolution of 
most photocopiers is less than 6001pi. Such dots will disappear after 
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photocopying because they are too small to be recognized by the 
photocopier. As such, the regions where the value of g c (x,y) is 1, will 
fade after photocopying because all dots in these regions are isolated 
and cannot be sampled by the photocopier. On other hand, the 
regions where the value of g e (x,y) is 0, will still remain because 
adjacent dot pairs are viewed as having a relatively large size, and 
can be sampled by the photocopier. Hence the latent image object 
will be able to appear after photocopying. 

Note both frequences, ± and ± , in eq. (33) should be high enough 

to exceed the resolution limit of the human visual system. According 
to the characteristics of the human visual system, the detailed 
structure of the counterfeit-proof layer will not be observable by 
unaided eyes. The regions where the value of g c ( x ,y) is 0 will look 
lighter in the grey scale than the regions where the value of g c (x,y) is 
1. 

Superposition of the counterfeit-proof layer with other watermark 
layers proctects the counterfeit-proof layer. Because of the simple 
structure of the counterfeit-proof layer, it is relatively easy to analyse 
the layer and reproduce it. 



Superposition of counterfeit-proof layer with other watermark layers 
is also operated according to eq. (18). The only necessary post- 
processing is for the region outside the latent image object. Figure 6 
of relevance here with Figures 602 and 603 representing typical dot 
patterns in object regions and non-object regions. Figure 604 
illustrates the post-processing for superposition of a counterfeit- 
proof layer with other watermark layers. Figure 605 is the 
superposition result and Figure 606 is the photocopying result of 
Figure 605.AS shown in Figure 604, when a dot 613 of the 
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watermark layer is superposed onto the counterfeit-proof layer, all 
other dots with a area indicated by the dash line box should be 
removed. The principle is that the superposition should not change 
the grey level of the regions where the value of g c (x,y) is 1. As the 
result of superposition, both the inside and the outside of the latent 
image object have the same grey level. Because the structure in the 
counterfeit-proof layer has a frequency exceeding the resolution of 
the human visual system, it looks like a patch of countious grey tone 
to unaided eyes. Figure 605 is a enlarged view of the superposition, 
Figure 606 shows the result after photocopying. The latent image 
object "P" appears clearly. 

Optical watermark in document delivery, ardival and authentication. 
The optical watermark can be applied to an electronic document. The 
optical watermark added to the document can be viewed as a seal to 
provide authenticity to the document. The visual apperance of the 
optical watermark can be disigned as a logo or seal of the authority 
to provide immediate trust. The embedded information can be the 
name, signature and logo of the authority, or some number or words 
related to the document content. 



As show in the Figure 7, application scenario 1 is an authority such 
as, for example, an immigration department of a government, which 
issues passports to citizens. Here, the optical watermark is attached 
to a page of the passport, either as the background or as a seal of the 
immigration department. A photograph of the passport holder is 
embedded into one layer, and the name and birth date is on the 
other layers. Finally, a special symbol is embedded into a random 
pattern watermark layer. Key lenses are distributed to various 
parties who need to verify the validity of the passport. The random 
key can be retained by the immigration department for final 
verification. Here, the passport is issued by the immigration 
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department, and the holder may need to be checked by other parties 
such as passport controller of other countries. 

Another type of application is illustrated in Figure 8, which is a 
service model. A service provider provides delivery and 
authentication services to customers. A customer, for example, a 
shipping company, issues a bill of lading through the service 
provider to a shipper or consignee. An optical watermark, having a 
shape of the carrier's logo, is placed on all non-negotiable bills of 
ladmg as background. Verification keys are distributed to banks and 
earner agents for authentication purposes when the shipper and 
consignee use the bill of lading to claim the money and cargo The 
key lenses can be replaced periodically, for example, every 6 months 
by the service provider for security reasons. 

The optical watermark described above can be readily applied to a 
document using more than one colour such as, for example, but not 
limited to, having different watermark layers into different colour 
channels in various colour spaces. Examples are CMYK and RGB. 

Whilst there has been described in the foregoing description a 
preferred embodiment of the present invention, it will be understood 

by those skilled in the technology that may variations or 
modifications may be made without departing from the present 
invention. 
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The Claims 

1. A method for producing a watermark on a document, the 
method including the step of: 

a) determining a required plural number of watermark layers and 
a dot patterns for each of the plurality of watermark layers; 

b) selecting at least one latent image object for each of the plural 
number of watermark layers and embedding each latent image 
object into its respective watermark layer; 

c) superposing the watermark layers to form the watermark; 

d) defining and generating a decoder for each of the number of 
watermark layers; and 

e) applying the watermark to the document. 

2. The method of claim 1, wherein the dot pattern for each of the 
number of watermark layers is a pattern defined on a two 
dimensional digital image plane. 

3. The method of claim 2, wherein the dot pattern is a basic two- 
dimensional dot array. 

4. The method of claim 2, wherein the dot pattern is a linear 
coordinate mapping of a basic two-dimensional dot array. 
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The method of claim 2, wherin the dot pattern also includes a 
non-linear coordinate mapping of a basic two-dimensional dot 
array. 



7. 



The method of claim 2, wherein the dot pattern is a random 
distributed dot array 



The method of claim 2, wherein the dot pattern is a result of a 
set of operations on a set of basic and other types of two- 
dimensional dot arrays. 



8. The method of claim 1, wherein the latent image objects 
contain information which is critical to the application. 



9. 



The method of claim 8, wherein the information is from the 
group consisting of: copy, void, a critical name, and a number 
from the document. 



10. The method of claim 1, wherein the latent image object is 
embedded into each watermark layer by a modulation method. 



11. 



The method of claim 10, wherein the modulation method is 
phase modulation. 



12. The met hod of claim 11, wherein the phase modulation 
includes a post-processing to smooth any abrupt phase 
changes along the edges of the latent image object. 
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13. The method of claim 1, wherein the decoder has a decoder 
structure related to a dot pattern structure of a carrier dot 
pattern of the watermark layer and in the direction where the 
latent image object is embedded. 



14. The method of claim 13, wherein the relationship is selected 
from the group consisting of: the same, and conjunct. 

15. The method of claim 10, wherein after modulation the 
watermark layer and its decoder each carries part of the 
information of the latent image object which is generated based 
on the latent image object and a random function. 



16. The method of claim 1, wherein the watermark layers are 
different to each other and are of sufficient difference to avoid 
interference between them as a result of them being 
superposed. 



17. The method of claim 13, wherin one of the watermark layers is 
a counterfeit-proof layer, the decoder, for which is a 
photocopier. 



The method of claim 17, wherein after the superposition of the 
watermark layers with the counterfeit-proof layer there is 
included a post-processing step to remove dots which are too 
close to adjacent dots in a non-object area. 



WO 02/23481 



PCT/SGOO/00147 



27 

19. The method of claim 1 when included in a method for printing 
a document for protection and authentication including the 
steps of: 

a) verifying the authenticity and copyright of the document before 
printing; 

b) generating the watermark according to the method of claim 1; 

c) controlling the printing process to protect the document and 
the watermark from attack; and 

d) generating the decoder device and distributing the decoder 
device to enable verification of the authenticity of the 
document. 



20. 



The method of claim 1, wherein the watermark is extended to 
colour documents. 



21. The method of claim 20, wherein the watermark layers are in 
different colour channels in various colour spaces. 

22. The method of claim 21, wherein colour spaces CM Y/ CMYK, 
HIS, XYA, Yuv and RGB are used. 



23. A watermark for use on a document, the watermark having: 
a) a required plural number of watermark layers, each of the 
plural number of watermark layers each being a dot pattern; 

at least one latent image object embedded into each watermark 
layer; and 



b) 

c) the watermark layers being superposed to form the 



watermark 
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24. The watermark of claim 23, wherein the dot pattern for each of 
the number of watermark layers is a dot pattern defined on a 
two dimensional digital image plane. 

25. The watermark of claim 24, wherein the dot pattern is a basic 
two-dimensional dot array. 

26. The watermark of claim 24, wherein said dot pattern for the 
watermark is a linear coordinate mapping of a basic two- 
dimensional dot array. 

27. The watermark of claim 26, wherin the dot pattern also 
includes a non-linear coordinate mapping of a basic two- 
dimensional dot array. 

28. The watermark of claim 24, wherein the dot pattern is a 
random distributed dot array 

29. The watermark of claim 24, wherein the dot pattern is a result 
of a set of operations on a set of basic and other types of two- 
dimensional dot arrays. 

30. The watermark of claim 23, wherein the latent image objects 
contain information which is critical to the application. 



31. 



The watermark of claim 30, wherein the information is from 
the group consisting of: copy, void, a critical name, and a 
number from the document. 
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32. The watermark of claim 23, wherein the latent image object is 
embedded into each watermark layer by modulation. 



33. The watermark of claim 24, wherein the modulation is phase 
modulation. 



34. The watermark of claim 33, wherein any abrupt phase changes 
along the edges of the latent image object are smoothed. 

35. The watermark of claim 33, wherein there is included a 
decoder for each watermark layer which has a decoder 
structure related to a dot pattern structure of a carrier dot 
pattern of the relevant watermark layer and in the direction 
where the latent image object is embedded. 

36. The watermark of claim 35, wherein the relationship is 
selected from the group consisting of: the same, and conjunct. 

37. The watermark of claim 35, wherein after modulation the 
watermark layer and its decoder each carries part of the 
information of the latent image object which is generated based 
on the latent image object and a random function. 



38. The watermark of claim 23, wherein the watermark layers are 
different to each other and are of sufficient difference to avoid 
interference between them as a result of them being 
superposed. 
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39. The watermark of claim 35, wherein one of the watermark 
layers is a counterfeit-proof layer, the decoder for which is a 
photocopier. 

40. The watermark of claim 39, wherein after superposition of the 
watermark layers with the counterfeit-proof layer dots which 
are too close to adjacent dots in a non-object area are removed. 

41. The watermark of claim 23 included on or in a document for 
protection and authentication. 

42. The watermark of claim 41, wherein the watermark is included 
on or in the document as a device selected from the group 
consisting of: background, seal, logo, graphic device, trade 
mark and a word. 

*3. The watermark of claim 23, wherein the watermark is 
coloured. 

14. The watermark as claimed in claim 43, wherein the watermark 
layers are in different colour channels in various colour 
spaces. 



45. The watermark as claimed in claim 44, wherein colour spaces 
CMY/CMYK, HIS, XYZ, Yuv and RGB are used. 
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